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We consider finite-state Markov chains that can be naturally de¬ 
composed into smaller “projection” and “restriction” chains. Possibly 
this decomposition will be inductive, in that the restriction chains 
will be smaller copies of the initial chain. We provide expressions for 
Poincare (resp. log-Sobolev) constants of the initial Markov chain in 
terms of Poincare (resp. log-Sobolev) constants of the projection and 
restriction chains, together with further a parameter. In the case of 
the Poincare constant, our bound is always at least as good as exist¬ 
ing ones and, depending on the value of the extra parameter, may be 
much better. There appears to be no previously published decompo¬ 
sition result for the log-Sobolev constant. Our proofs are elementary 
and self-contained. 

1. The setting. In a number of applications, one is interested in find¬ 
ing tight, nonasymptotic upper bounds on the mixing time, that is, rate of 
convergence to stationarity, of finite-state Markov chains. One important ex¬ 
ample arises in the analysis of Markov chain Monte Carlo algorithms. These 
are algorithms for sampling and counting combinatorial structures that are 
founded on Markov chain simulation. The efficiency of these algorithms de¬ 
pends crucially on the rate of convergence to stationarity of the Markov 
chain being simulated. 
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In proving rapid convergence to stationarity, Poincare and latterly log- 
Sobolev inequalities have proved to be powerful tools. The larger the con¬ 
stants in these inequalities, the faster the convergence to stationarity. (These 
and other informal remarks are made rigorous in the following section.) Here 
we consider hnite-state Markov chains whose description suggests a natural 
state-space partition. This partition naturally induces a number of restric¬ 
tion chains, in which transitions are restricted to occur within blocks of the 
partition, and a projection chain, whose states are the blocks themselves. 
The hope is that by computing Poincare or log-Sobolev constants for the 
restriction and projection chains we can obtain a Poincare or log-Sobolev 
constant for the original chain. Various authors, including Madras, Martin 
and Randall [[13]-[15]], have investigated this approach. 

Sometimes it may be possible to apply the decomposition step inductively, 
as was done by Cooper, Dyer, Frieze and Rue [4] in the context of spin models 
on “narrow grids” and by Jerrum and Son [9] for the “bases-exchange walk” 
for balanced matroids. In these applications, it is particularly important that 
our arguments give as little as possible away at each decomposition step. 

Clearly there is a need for general decomposition theorems that relate, 
say, the Poincare constant A of the original chain as tightly as possible to 
those of the restriction and projection chains. The existing decomposition 
theorems of this sort seem all to rest ultimately on an unpublished result 
of Caracciolo, Pelissetto and Sokal [1]. (Note, however, that a statement of 
their result and a version of their proof were published as an appendix to 
an article by Madras and Randall [13].) 

Our hrst goal, then, is to provide an elementary, self-contained and acces¬ 
sible account of the basic decomposition result. However, in developing the 
result from first principles we hnd we can derive a statement that is consid¬ 
erably sharper than the current ones in many situations. For example, in the 
context of inductively defined Markov chains, existing decomposition results 
cannot yield inverse polynomial bounds on A (and hence polynomial bounds 
on mixing time), even when the depth of the induction is logarithmic. In 
contrast, we are able to give inverse polynomial bounds on A for inductively 
dehned Markov chains, and are even able to recover the result of Jerrum 
and Son [9] on the bases-exchange walk for balanced matroids, where the 
depth of the induction is linear in some natural measure of the input size. 

It transpires that the proof of the decomposition result for the Poincare 
constant carries over straightforwardly to the log-Sobolev constant. In many 
situations the optimal log-Sobolev constant seems to be within a small con¬ 
stant factor of the optimal Poincare constant (spectral gap); the advantage 
of the log-Sobolev constant in these situations is that it translates to a 
tighter bound on mixing time (construed as the time to convergence to near 
stationarity in norm). To the best of our knowledge, this is the hrst gen¬ 
eral decomposition result for log-Sobolev inequalities, although it should be 
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mentioned that Cesi [2] gave an argument that applies when the state space 
is a Cartesian product. 

We have stated our results for finite-state Markov chains, since that seems 
to be the natural setting given the potential applications to Markov chain 
Monte Carlo algorithms. However, everything extends (with no notational 
change) to countably infinite state spaces and (with appropriate notational 
changes and possible regularity conditions) to uncountable state spaces. 

2. Poincare constant via decomposition. Consider an ergodic Markov 
chain on finite state space with transition probabilities P: x 12 ^ [0,1] 
and stationary distribution vr: 12 —> [0,1]. We assume that the Markov chain 
is time-reversible, that is to say, it satisfies the detailed balance condition 

tt{x)P{x, y) = TT{y)P{y, x) for all x, y G 12. 

Let 12 = 12o U • • • U f2m-i be a decomposition of the state space into m disjoint 
sets. As usual, we use \m] := {0,..., m — 1} to denote the first m natural 
numbers. 

Following [15], we define vf: [m] —> [0,1] by 

^{i) = 7r(x) 

and define P: [m] x [m] —> [0,1] by 

P{i,j) :=Tt{i)-^ T^{x)P{x,y). 

x^Q.i 

The Markov chain on state space [m] and with transition probabilities P is 
the projection chain induced by the partition {12j}. Since the original Markov 
chain is time-reversible, so is the projection chain. It is easy to check, using 
this observation, that the projection chain has vf as a stationary distribution. 

For each i G [m] the restriction Markov chain on 12j has transition prob¬ 
abilities Pj: 12j X 12j ^ [0,1] defined by 

{ P{x,y), ifx/y, 

1— 'Yi P{x,z), if X = y. 

zGQi\{x} 

Again, the restriction chain inherits time-reversibility from the original chain, 
and so it has TTjillj ^ [0,1] as a stationary distribution, where 7rj(x) = 
'7r(x)/7f(i). In applications, we require the projection chain and all the re¬ 
striction chains to be irreducible; in which case the various stationary dis¬ 
tributions TT and TTo,..., TTm-i are unique. 
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Let /: O —> M be an arbitrary test function. The expectation and variance 
of / with respect to vr are of course given by 

Ett/ := XI 

and 

Var^ / := X 7r(x)(/(x) - ff, 

respectively. The Dirichlet form associated with / and P is dehned as 

X ^(^)E(a;,y)(/(a;)-/(y))^. 

x,y&Q 

Consider now a Poincare inequality of the form 

(1) <?7r(/,/) > AVar^/ 

that holds uniformly over all / : O —> M, with A > 0 being the corresponding 
Poincare constant. It is well known that a lower bound on A translates 
directly to an upper bound on mixing time of a Markov chain. To avoid 
technical problems associated with nearly periodic Markov chains, assume 
that loop probabilities are uniformly bounded away from 0. [Alternatively, 
interpret P{-,-) as the transition rates of a continuous-time Markov chain 
on n.] Denote by P^{x,-) the t-step distribution of the chain, given that 
a; G D is the initial state. Then there is a function t: D x (0,1] —> N with 

( 2 ) = 

such that (x,-) — vtIItv < where || • ||tv is total variation norm 

(i.e., half the norm). For a proof of this claim that is valid for general 
(i.e., not necessarily time-reversible) Markov chains, refer to [8], Section 5.2, 
interpreting q there as the reciprocal of our A. 

Observe that in our notation for expectation, variance and so forth, we 
make explicit the probability distribution vr as a subscript, because this 
varies throughout our proofs. For example, we may write Poincare inequal¬ 
ities for the projection and restriction chains as £n{f,f) > AVar^f/ and 
£ni{f,f) > AiVarTTi/, respectively. Naturally, tt (resp. iTi) is to be consid¬ 
ered as a probability distribution on [m] (resp. Dj), and f as a function 
on [m]. 

Suppose the projection chain and the various restriction chains satisfy 
Poincare inequalities with constants A, and Aq, ..., Am-i, respectively. Dehne 
Amin = minj Xi. We are interested in obtaining a Poincare inequality for the 
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original Markov chain, with Poincare constant A = A(A, AmiruT), where 7 is 
a further parameter 


(3) 


7 


max max 

2G[m] x^Q,i 


E 

j/en\Ui 


P{x,y). 


Of course, we would like A to be as large as possible. Informally, 7 is the 
probability of escape in one step from the current block of the partition, 
maximized over all states. Given this interpretation, it is clear that 7 never 
exceeds 1, and may be much smaller in many applications. It is in these 
applications that we improve on existing decomposition bounds. 


Theorem 1. Consider a finite-state time-reversible Markov chain de¬ 
composed into a projection chain and m restriction chains as above. Sup¬ 
pose the projection chain satisfies a Poincare inequality with constant A, and 
the restriction chains satisfy inequalities with uniform constant Amin- -het 7 
be defined as in (3). Then the original Markov chain satisfies a Poincare 
inequality with constant 


A 


:= mm 


A AAmin 1 

3’37 + Ai’ 


Proof. Consider an arbitrary test function /ill—>M. Our starting 
point is the decomposition of Var^ / with respect to the partition fl = 
Hq U • - • U Urn—1; 

(4) Var^/= 7 r(i)Var^,/+ Y ^(*)(E 7 ri / - /)^ 

i£[m] i£[m] 


and a similar decomposition of the Dirichlet form. 


(5) 


where 




je[m] 


*jgH 


xGfli 

y£^j 


Identity (5) is almost content-free and comes from partitioning the terms in 
the definition of £nif,f) according to whether i and j are in the same or 
in different blocks of the partition. Identity (4) has a little more substance, 
but is nevertheless standard and can be obtained through simple algebraic 
manipulation. It states informally that the variance of / may be obtained 
by summing the variances within blocks of the partition and the variance 
between blocks. 
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In summations and so forth, variables i and j always range over [m], so 
we are not explicit about their range in what follows. For all i,j with j 
and P{i,j) > 0 , define 7 r| : 0* —> [ 0 , 1 ] by 




TTi (x) := 


P{hj) 


Note that vr^ is a probability distribution on Oj. 

The hrst term on the right-hand side of (4) we simply bound as 

1 


( 6 ) 


^7r(i)Var^,/ <^—7r(z)£:^,(/,/) 
i i 

'^min 


The second term we transform, starting with an application of the Poincare 
inequality for the projection chain, 

^7f(z)(E^J-E^/f 

i 








X [(E^, / - E_. ff + (E., / - E^. ff + (E^. / - E^^, ff] 

i i 3 3 


(7) =^pi+S 2 + S3], 

where 


Si:=^7f(z)P(i,j)(E^,/-E,,/f,.... 

We proceed to bound Si, S 2 and S 3 separately, noting that Si and S 3 are 
equal by time-reversibility. Eor the second of these we have 


(8) 


-f{y)) 


y£Uj 


(9) 

<X^TT{l)P{t,j) {fix) 

^ vr(z)P(z,j) 

-f{y)? 


y£Qj 
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(10) 


= T^{x)P{x,y){f{x) - f{y)y 

i^j x£Qi 
y£Qj 

~ X] > 


where ( 8 ) uses the fact that TT{x)P{x,y)/7r{i)P{i,j) is a joint distribution 
on llj X il.j whose marginals are nj and vr®-, and (9) is seen to be Cauchy- 
Schwarz, once we have noted that 

y- T^{x)P{x,y) ^ 

Hypyj ) 

yeUj 

by definition. 

Now for Si. Using standard facts about variance, 

Var.i / = Var-i (/ - E^. /) 

i i 

(11) = E ^lix)ifix) - ff - (E., / - E^, ff, 

% 

so that certainly 

(12) (E,,/-E^J)E ^ %\{x){f{x)-P^jf. 

i 

X<^^i 

Thus we have the bound 

Si < E^(*)(P(bj) E ^lix){f{x)-P^jf 

x£Ui 


= E^(^) E 'Xi{x){f{x) -Enjf E 

i j. 

2 


nj{x)P{i,j) 

TTi{x) 


= E^(^) E '^iix)ifix) -EnJ) E 

i X^^i j . 


(13) 

(14) 

(15) < Y^E^(^)‘^^i(.^’'^)’ 

^min 


<7E7r(i)Var^, / 
i 

7 


where (13) applies the definition of (14) applies the definition of 7 and 
(15) applies the Poincare inequalities for the restriction chains. 

Substituting (10) and (15) in (7), and recalling that Si = S 3 , we have 


(16) E J-Ett ff < E ^(*) (/> /)• 


2A 




AAn 
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Then substituting (6) and (16) into (4) yields 

(17) Var^ ^^(*)-^TTi(/,/)• 

AAmin • 

Finally, comparing (17) with (5), we see that 

<?7r(/,/) > AVar^ /, 

where A is as in the statement of the theorem. □ 


The first thing to note is that 7 < 1, so that always A = O(AAmin)) match¬ 
ing existing decomposition results (e.g., [1]). It may be the case that 7 is 
indeed a constant (e.g., decompose a random walk on [re] into k random 
walks on [re/A:], where we assume for convenience that k divides re). In this 
case, 7 = 1 and we get no improvement over existing bounds. 

At the other extreme, there are situations, for example, spin systems on 
fragments of the Bethe lattice or narrow grids, where 7 and A are of the same 
order of magnitude. Applying Theorem 1 inductively then yields bounds on 
the spectral gap that are inverse polynomial in the problem size re, provided 
the depth of recursion is O(logre). Section 4.3 treats such an example. 

This seems about the best that can be achieved using a parameter as 
“global” as 7 . To go further, we need a much stricter pointwise constraint 
on the distributions frj. For example, if we know that 

(18) (l-r?)7ri<7r^ <(1-Fr?)7ri, 

pointwise, whenever irj is defined [i.e., whenever P{i,j) > 0], then 

(19) (E,, / - E,, ff < (1 + 7 ) Var^, / - Var,, / 

i i 

< [I + vi)\sx^J - {I - r]) 

(20) < (1-hr?) Var^,/-(1-?7)Vaiv, / 

(21) =2r/Var^,/, 


where (19) comes from (11), and (20) from the fact that ^i(^)(/(^) 

^)^ is minimized at /r = E^r. /. Introducing the modified parameter 


( 22 ) 


7 := 2 r?max Y 
ie m . ... 


we obtain: 


Corollary 2. Suppose that (18) is satisfied for some r] > 0 and that 7 
is as defined as in (22). Then Theorem 1 holds with 7 replacing 7. 
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Proof. Simply use (21) in place of (12) in the derivation of inequal¬ 
ity (15). 

□ 

Note that 7 may even be 0 (which happens if t/ = 0), as in the case of the 
n-dimensional Boolean cube. When that happens, Si = S 3 = 0 and we save 
a factor 3 in the argument, leading to: 

Corollary 3. /f 7 = 0 , then Theorem 1 holds with A := min{A, Amin}- 

For the Boolean cube, Corollary 3 immediately gives the exact bound on 
spectral gap. Even when 7 > 0 we may be able to compare the given Markov 
chain with one with reduced transition probabilities for which 7 = 0 . For 
example, in the case of the bases-exchange walk on a balanced matroid, we 
may “thin down” the transition probabilities between and until they 
form a fractional matching (which is possible by a result in [7]). Thus we 
recover the known bound on the spectral gap for balanced matroids. All this 
is covered in detail in Section 4.5. 

3. Log-Sobolev constant via decomposition. The program described above 
extends to the log-Sobolev constant with little work. Following Diaconis and 
Saloff-Coste [5] (and others), define the entropy-like quantity 

(23) CM) ■■= E.[/'(ln/2 - ln(E, f))]- 

Again, we indicate the probability distribution tt explicitly as a subscript, 
so we can talk about CTr^{f) and so forth. A log-Sobolev inequality is an 
inequality of the form 

SMJ)>ocCM) 

that holds for all /: —> M. The motivation for studying the log-Sobolev 

constant a is the analogue of ( 2 ), 

(24) t(,,e)=o(i(lnl„^ + lni)), 

which provides an estimate, this time in terms of a, for the number of steps 
sufficient to achieve {x, ■) — ttHtv < [To avoid trivialities, assume 

7 r(x) < e~^ in (24).] The estimate (24) of mixing time may be read off from 
[5], equation (3.3), assuming loop probabilities are bounded away from 0. 
(Diaconis and Saloff-Coste worked in continuous time, avoiding potential 
problems associated with nearly periodic Markov chains.) The key point to 
note is that ln(l/ 7 r(x)) in (2) is replaced by lnln(l/ 7 r(x)) in (24). This may 
not seem like a major improvement until we recall that 7r(x) is typically 
exponentially small as a function of instance size. 
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Our aim, then, is to find a = a(a, aminj 7 ) that satisfies 

Obviously we want a to be as large as possible. Our analogue of Theorem 1 
is: 


Theorem 4. The setting is exactly as in Theorem 1. Suppose the pro¬ 
jection chain satisfies a log-Sobolev inequality with constant a and that the 
restriction chains satisfy inequalities with uniform constant amin- Then the 
original Markov chain satisfies a log-Sobolev inequality with constant 


. f a 

a:=mmj-. 


Q^®min 1 

37 + d J 


Proof. Just as with variance, T7r(/) may be decomposed with respect 
to the partition O = Oq U • • • U flm-i, the analogue of identity (4): 

(25) TM) = Y.^{i)C^fif) + ^ 7 r(i)(E^, /')(ln(E,, f) - ln(E^ f)). 

i i 

Since C-^{f) is a less familiar quantity than variance, we offer, in an adden¬ 
dum, a derivation not only of (25), but also of a number of other identities 
and inequalities used in this section. By analogy with (4), the first term 
expresses the entropy within blocks of the partition and the second term ex¬ 
presses the entropy between blocks. [Compare the second term in (25) with 
the right-hand side of (23), observing how is now the appropriate 

“averaging of /” over , taking on the role of Et^^ / in the earlier calcula¬ 
tion.] The decomposition of entropy expressed in (25) has been exploited by 
other authors (e.g., [12]). 

We deal with the first term exactly as before: 

^7r(i)£^,(/) 

I I ^ 

( 26 ) 

< -- (/’/)• 

^min ^ 

The second term we transform, in an analogous manner to (7), starting with 
an application of the log-Sobolev inequality for the projection chain, 

^ 7 r(i)(E^, /')(ln(E,, f) - ln(E^ f)) 

i 
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(27) 

(28) 
where 


+ iVE^-VE;j^y 


+ iVE^-VE^f] 


— + 5^2 + S 3 ], 


Si = ^ VE^f,.... 

Tackling S 2 first, we have 
,29) 


i¥^j 


yeflj 


(30) 


= J2J2 ^{x)P{x,y){fix) - f{y)f 

i^j xGQi 
yGUj 

~ X/ > 


where (29) is Jensen’s inequality applied to the convex function g{^,C) ■= 
iVC- Vcy defined on C > 0 . (This is an artifice borrowed from [11]; see 
Section 3.1 for details and see [12] for related applications.) 

For Si (which equals S 3 by time-reversibility), we have the bound 


(31) 


-f{y)f 


i^j x,y&ni 


(32) 

= '^iix)My)ifix) - f{y)y 



i x^y^Q^i 

3 '■ 3^i 

(33) 

< 27^7(i)Var^, / 
i 


(34) 

'^min ^ 


(35) 

^min 



where (31) recycles the Jensen artifice (see Section 3.1), (32) applies the 
definition of Trj, (33) applies the definition of 7 , (34) applies the Poincare 
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inequalities for the restriction chains and finally (35) applies the general 
inequality a < A/2 (see, e.g., [5]) that relates Poincare and log-Sobolev 
constants. [Strictly speaking, we must interpret Amin here as the minimum 
over the optimal Poincare constants (i.e., spectral gaps) of the m restriction 
Markov chains.] 

Substituting (30) and (35) into (28), and recalling that Si = S 3 , we have 


(36) 


^ 7 r(i)(E^, /')(ln(E^, f) - ln(E^ f)) 





37 




Then substituting (26) and (36) into (25) yields 

(37) C^{f) (/’/)• 

. , . CtCiTTiiri 

i -=^2 ^ 


Einally, comparing (37) with (5), we see that Snif,/) > where a is 

as in the statement of the theorem. □ 


The remarks following the proof of Theorem 1 apply also to Theorem 4. 
In particular, if (1 — ri)'Ki < < (1 + 7 )vrj, then 

(38) (Ve,, f-VE.,ff<2pYaT^J, 

i 

using Jensen’s inequality again, but this time with an optimal coupling of 
the two random variables (r.v.’s) (see Section 3.1), yielding; 

Corollary 5. Suppose that (18) is satisfied for some 7 > 0 and that 7 
is as defined as in (22). Then Theorem 4 holds with 7 replacing 7 . 

Again, when 7 = 0 we save a factor 3. 

Corollary 6. 7/7 = 0, then Theorem 4 holds with a := min{d,amin}- 

3.1. Addendum: proofs of an identity and some inequalities. This adden¬ 
dum contains derivations of some of the possibly less obvious identities and 
inequalities used above. 

Proof of identity (25). By appropriate scaling of the function /, it 
is enough to establish (25) when E^r/^ = 1. With this simplification, 

CM) = E. [f In f] E., [f In f] 
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and 

^^(z)£^.(/) = ^^(i)E^J/2(ln/2 -ln(E^. f))]. 

i i 

Subtracting the latter from the former, we obtain 

CAf) - E (/) = E Aim, f) ln(E^, f), 

i i 

as required. □ 


Proof of inequality (29). Let X and Y be r.v.’s taking values in 
Qi and flj, respectively, and with joint distribution given by 


Pr(X = x AY = y) 


7r{x)P{x,y) 

^{i)P{i,j) 


Thus the marginal distribution of X (resp. Y) is vr^ (resp. vr*). Since, by 
calculus, C) := {VC~ VC)'^ is convex in ^, (^ > 0, Jensen’s inequality yields 


= {VE[f{xA -VE[fiYf]f 
<E[{fiX)-fiY)f] 

ySQj 


□ 


Proof of inequality (31). As above, but now with X and Y being 
independent r.v.’s with the appropriate distributions. □ 


Proof of inequality (38). Assume tTj otherwise there is noth¬ 
ing to demonstrate. Let X and Y be r.v.’s that take values in flj, with joint 
distribution satisfying the following conditions: (i) X has distribution tt^, 
(ii) Y has distribution vr^ and (hi) Pr(X ^ Y) = ||7rj — tt^Htv- H is well 
known that such an optimal coupling of two r.v.’s exists. Denote by 


'4’{x, y) := Pr(X = x AY = y) 


the joint distribution of X and Y. Dehne 


i^{x,y) 


0 , 

V’(T,y), 


if x = y, 
otherwise. 


Partition D into two sets it = Au B such that 7rj(x) — A A) > 0 ^ii 
X G A, and vr^(y) — T^i{y) > 0 for all y & B. By assumption, A and B are 
non-empty. Optimality of the coupling of X and Y entails '^y^ix^y) = 
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max{7ri(a;) - 7r^(x),0} and = max{7r^(y) - 7rj(y),0}. Thus, by 

Jensen’s inequality, 

i 

= {VE[f{Xf]-VE[f{Yf]f 

<E[{f{X)-f{Y)f] 

= fiy)f 

x,yGfli 

<2 Y, i^ix,y)[{f{x)-E^jf+ {f{y)-E^jf] 

x,yefli 

<2r]J2 - E^, ff + 2r]J2 '^i{y){f{y) “ E^i ff 

xGA y&B 

< 2r/Var^,/, 
as required. □ 

4. Examples. In this final section we collect a number of illustrative 
examples. The aim is more to rederive a variety of existing results in a 
simple, uniform manner than to obtain new results. 

4.1. Toy example. Consider the symmetric random walk on the 2n ver¬ 
tex “pince-nez” graph in Figure 1 obtained by joining two disjoint n cycles 
by a single edge. Suppose transitions within cycles occur with probability 
^, while the unique transition between cycles occurs with probability P < | • 
Loop probabilities are defined by complementation. The transition probabil¬ 
ities are symmetric, so the random walk is time-reversible and its stationary 
distribution is uniform. 

Now decompose the set of vertices (states) into two disjoint subsets, 
Qq and rii, where Uq contains the n vertices in the first cycle and fli contains 



Fig. 1. Pince-nez graph (n = 8J. 
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the n vertices in the second cycle. The spectral gap for each cycle consid¬ 
ered in isolation is |(1 — cos(27r/n)). (Diaconis and Saloff-Coste treated this 
example in [5], Section 4.2. The factor | arises because our transition proba¬ 
bilities are ^ instead of i.) Since 1 — cosx > 2x^/5 for 0 < x < 7 r/ 2 , we have 
that the spectral gap for each restriction chain is at least 167 r^/ 15 n^ (as¬ 
suming re > 4), so we may take Amin = 10re“^. The projection chain in this 
example is the symmetric two-state chain with transition probability p/n 
between states, so we take A = 2 p/re. Finally 7 = p. (Recall that 7 is the 
maximum, over all states, of the probability of exiting from the current 
block of the partition of the states.) Theorem 1 yields, as Poincare constant 
for the random walk on the pince-nez. 


A 


= mm 


2p 20 ] 

3re3 2re2 j' 


Note that A = n(re“^) when p = n(re“^) and A = Vl{pn~^) when p = 
in the latter case, our estimate is tight to within a constant factor, and a 
factor n? better than existing decomposition bounds which have the form 
A = 0(AAmin) = 0(pre“^). 

A log-Sobolev inequality may be obtained equally simply by using a sim¬ 
ilar calculation. The restriction chains satisfy a log-Sobolev inequality with 
constant 167 r^/ 75 re^ ([5], Section 4.2), so we may take Omin = 2re“^. The 
log-Sobolev constant for the two-state projection chain is d = p/re (see [5], 
Theorem A.2). Thus, by Theorem 4, 


a = min 


A ^ ] 

3re ’ 3re3 -|- re^ j 


4.2. Product of two Markov chains. Consider two finite-state time-reversible 
Markov chains {X,Px) and (Y,Py) with state spaces X and Y. There 
are a number of ways to define a product Markov chain (n,R) on = 

X xY, but one which suits our purpose is to define the transition probabil¬ 
ities P in terms of the transition probabilities Px and Py as follows. For all 
{x,y),{x\y') G 0 , 


P((x,y),(x',yO) 


' Pxix,x'), 

PYiy,y'), 

Pxix,x)+PY{y,y) - 1, 


lo. 


if x' 7^ X and y' = y, 
if x' = X and y' / y, 
if x' = X and y' = y, 
otherwise. 


For the loop probabilities to be nonnegative, we require Px {x,x) + Py {y,y) > 
1 for all (x, y) and we assume this from now on. 

Our goal is to establish a Poincare constant A for {kl,P) in terms of 
those for {X,Px) and {Y,Py): let us call them Ax and Ay, respectively. 
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For convenience, identify X with [n]. Then, writing Oj := {i} x Y, we have 
the natural decomposition ^1 = X xY = Uig[n] (Of course, we could have 
reversed the roles of X and Y, and indexed the restriction chains by T.) 
Each of the restriction chains is isomorphic to (T, Py) and so Amin = Ay. The 
projection chain is isomorphic to {X,Px) and so A = Ax- By symmetry, 
nj = TTj whenever the former is defined, and hence 7 = 0 and we are in 
the situation of Corollary 3. We obtain A = min{Ax,Ay} as the required 
Poincare constant for (n,P), and this is tight. Exactly the same argument 
applies to the log-Sobolev constant. 


4.3. One-dimensional Ising model. Consider the path of length n, that 
is, the graph with vertex set [n] and edges joining vertices differing by 1 . 
Configurations of the Ising model are just assignments u : [n] ^ 1, +1} of 

±1 “spins” to the vertices of the graph. The Hamiltonian of the Ising system 
on the path is defined by 

n—2 

■^(^) — “ cr{i)a{i + l)]/ 2 ; 

i=0 

in other words, we count 1 for every pair of adjacent unlike spins. Denote the 
set of all 2” configurations by D. We wish to sample configurations from the 
Boltzmann-Gibbs distribution '/r(cj) := exp{—fiH(a))/Z on D, where Z := 
exp(—/3if(cr)) is the partition function of the system and /3 G M+ is 
inverse temperature. (What has been described is the ferromagnetie Ising 
model, which favors like spins; see [3] for background.) 

One standard way to construct a Markov chain on D with stationary 
distribution vr is through single-site heat-bath dynamics. For i G [n] and 

a:[n] ^ {— 1 , let cj[j,_|_i] (resp. crjj,_ 1 ]) be the configuration that agrees 

with a at all vertices except possibly vertex i, where cr[j,_[resp. 

_i](i) = — 1]. The transitions of our heat-bath Markov chain are defined 

by the following trial, where a is the current state: 


1. Select i G [n] uniformly at random. 

2. Let 


_exp{-/?if(o-[^^^i])}_ 

exp{-/3iL(cr[i^+i])} -h exp{-/3iL(o-[i,—q)} ' 


Then with probability p, the new state is fjjj,_and with probability 

l—p, the new state is fijj,_q. 

For convenience, we imagine that there are extra vertices 0 and n with 
specihed hxed spins, so that p G {^,e^^/(e^ -|- e“^)}. 

Choose a vertex m G [n] as close to the midpoint of the path as possible 
(e.g., m= [n/ 2 j) and partition the configurations into two sets D = D_|_UD_, 
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where (resp. 0 _) is the set of all configurations a with a(m) = +1 [resp. 
a[m) = — 1]. Consider the restrictions of the Markov chain to 0+ and n_, 
and the corresponding projection chain (which in this case has just two 
states). 

A little optimization gives the spectral gap of the projection chain as 
A > l/(cosh/3)^n. The parameter 7 satisfies 7 < 1/(1 + Thus 


A > min 


3(cosh/3)2n’ 1 + (3/4) (e^l^ + 1) 


Each restriction chain is a direct product of two independent Ising systems 
on at most [n/ 2 j vertices: independent because we fixed a spin at the middle 
of the path. The spectral gap of a direct product is the minimum of the 
spectral gaps of the components, as we saw in Section 4.2. So, denoting by 
Afc the spectral gap of the ferromagnetic Ising system on [k\ (with updates 
at any given site occurring at rate/probability 1 /n), we have the recurrence 


Afc > min 


\k/2\ 


3(cosh/3)2n’ 1 + (3/4)(e2^ + 1) 


This has solution A„ = n(n“'^), where c = 1 + log 2 {l + |(e^^ + 1)}. So, at 
any fixed temperature, the spectral gap is bounded by an inverse polynomial 
in n whose exponent c tends to 1 + log 2 | < 2.33 as /3 ^ 0. In light of (2), 
the mixing time scales as . 

A similar argument applies to the log-Sobolev constant. However, the 
bound on a, the log-Sobolev constant of the two-state projection chain, is 
l/2(cosh/3)^n (see [5], Theorem A.2), which is worse than the bound we had 
for A by a factor of 2 . As a result, we obtain = Q{n~^ ), where c' = 1 + 
log 2 {l -t- |(e^^ -)- 1)}. So at any fixed temperature the log-Sobolev constant 
is bounded by an inverse polynomial in n whose exponent c' tends to 1 -|- 
log 2 4 = 3 as /3 —> 0. Although d > c, we recall that, by (24), the mixing time 
scales as rd logn, which is an improvement on for small enough [5. In a 
sense, these are both poor results, since the one-dimensional Ising model does 
not exhibit a phase transition and we should expect mixing time O(nlogn) 
at any temperature (although with a constant of proportionality depending 
on (5). Note, however, that if we had used existing decomposition theorems, 
we would have lost a factor n at each level of recursion, leading to a bound 
on spectral gap that diminishes with n faster than any inverse polynomial. 

When the temperature is sufficiently high (i.e., (5 is sufficiently close to 0), 
we get a better bound by switching to Corollaries 2 or 5. Indeed, since 7 —> 0 
as /3 —> 0, the bounds on both spectral gap and log-Sobolev constant are of 
the form H(I/re^^'^) with 5 tending to 0 as n^oo. (Very recent work [16] 
improved on this result by showing that may be replaced by n (in the 
case of spectral gap) and nlogn (in the case of log-Sobolev constant) for all 
(3 up to some critical value. This remark applies equally to Section 4.4.) 
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4.4. Ising and other spin models on trees. The calculation of Section 4.3 
carries over, with very little change to balanced trees of bounded degree. 
Thus we can treat balls of given radius in the so-called Bethe lattice of co¬ 
ordination number r; loosely, the infinite regular tree of degree r. Again, 
for fixed r and /3, the Poincare and log-Sobolev constants are inverse poly¬ 
nomial. This was already known (see [10] for inverse polynomial bounds on 
spectral gap), although the fact that spin systems in general and the Ising 
model in particular have polynomial mixing time on trees is not so obvious. 

4.5. Walks on the Boolean cube and balanced matroids. Consider the 
random walk on the n-dimensional Boolean cube in which transitions (in¬ 
cluding loops) all occur with probability l/(n -|- 1). There is a natural de¬ 
composition of the n-dimensional cube into two (n — 1 )-dimensional cubes 
connected by a perfect matching. Clearly 7 = 0 and we are in the situation of 
Corollary 3. Then A = 2/(n -|- 1) and, by induction, A = 2/(n -|- 1). Likewise, 
a = l/{n-\-l) ([5], Theorem A.2, again) and hence a = l/(n -|- 1). These 
results are of course well known; see, for example, [5], Section 4.1. 

More interestingly, there is a nontrivial Markov chain—the so-called bases- 
exchange walk on a balanced matroid—which retains just enough of the 
properties of the cube to be treatable by essentially the same approach. 
We shall be very brief in describing the setting; refer to [7] and [9] for a 
more expansive treatment. Let Li be a hnite ground set and let B C 2^ a 
nonempty collection of subsets of E. We say that B forms the collection of 
bases of a matroid M = {E,B) if the following “exchange axiom” holds: For 
every pair of bases X,Y G B and every element e gY \ X, there exists an 
element f G X\Y such that X U {e} \ {/} e B. It is easy to show that every 
basis must have the same size, which is called the rank of M. Denote by 
m = \E\ the size of the ground set and by r the rank. A concrete example 
of a matroid is provided by the set of spanning trees of a finite undirected 
graph G. Here we interpret E as the set of edges of G and interpret B as 
the set of all spanning trees. The rank is of course r = n — 1, where n is the 
number of vertices of G. The exchange axiom is easily checked. 

Two absolutely central operations on matroids are contraction and dele¬ 
tion. If e G Li is an element of the ground set of M, then the matroid M\e 
obtained by deleting e has ground set £'\{e} and bases B{M\e) = {X YE\ 
{e} \X G B(M)}; the matroid M/e obtained by contracting e has the same 
ground set as M \ e, but bases B{M/e) = {X Y E \ {e} : X U {e} G B{M)}. 

The exchange axiom suggests a very natural Markov chain on the set of 
bases B. Suppose the state (basis) at time t is Xt G B. Then the state at 
time t -|- I is obtained as the result of the following trial: 

Step I. Choose eG E and f G Xt independently and uniformly at ran¬ 
dom. 
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Step 2. If X* U {e} \ {/} G B , then Xt+i ^ XtU {e} \ {/} else X^+i ^ 

It is straightforward to check, using the exchange axiom, that this Markov 
chain { Xt ) is irreducible; furthermore, it is clearly time-reversible and has 
uniform stationary distribution. It has been conjectured that ( Xt ) is rapidly 
mixing (i.e., achieves total variation distance e > 0 from the stationary dis¬ 
tribution in a number of steps polynomial in m, r and loge“^) for all ma- 
troids M. Although there is little evidence in favor of this conjecture, there 
is at least an interesting class of matroids, namely the “balanced” matroids, 
for which rapid mixing was established [7]. The class of balanced matroids 
includes all regular matroids, and hence graphic matroids (i.e., ones whose 
set of bases may be realized as the set of all spanning trees of a graph). 

Fix any e€ E. Since there is a natural isomorphism between M and the 
disjoint union of M \ e and M/e, the bases-exchange walk is a natural can¬ 
didate for the decomposition method. Let Qq (resp. fli) be the set of bases 
that does not contain e (resp. does contain e). Note that Hq is isomorphic to 
M\e and Hi is isomorphic to M/e, enabling us to argue inductively about 
the two restriction chains. 

Rather than define the notion of balanced matroid explicitly here, let us 
just note two of the consequences of balance: 

1. Contractions and deletions of a balanced matroid are themselves bal¬ 
anced, in particular, M \ e and M/e are balanced matroids. 

2. The transitions of the bases-exchange walk that cross from M\e to M/e 

and vice versa support a fractional matching. That is, there is a function 

■u;: Hq X Hi —> M that satisfies: 

• w{x, y) >0 for all x, y; 

• w{x, y) > 0 entails P{x, y) > 0; 

• ='t(Hi) for all x and ='^(^o) for all y. 

Define a new Markov chain on H, with transition probabilities P, as fol¬ 
lows. Transition probabilities within Hq and Hi are unchanged, so the restric¬ 
tion chains are also unchanged. Transitions from x G Hq to y G Hi and vice 
versa occur with probability P{x,y) = P{y,x) := w{x,y)/{rm). Note that 
nonzero transition probabilities in the bases-exchange walk are all l/(rm) 
and that the new Markov chain does not add any transitions to those already 
available. From these observations it follows immediately that for any pair of 
distinct states x,y, it is the case that P{x,y) < P{x,y). Thus, it is enough to 
bound the Poincare constant A for the Markov chain with modified transi¬ 
tion probabilities P. (This is a trivial application of the comparison method 
in [6].) 


20 


JERRUM, SON, TETALI AND VIGODA 


The key point about P is that it uses the fractional matching to spread 
the transitions between Oq and fli evenly. It is easily checked that 7 = 0 and 
that we are in the situation of Corollary 3. The projection chain (derived 
from P by projection onto {flo) ^^i}) has two states {0,1} with 7 r( 0 ) = '/r(Oo) 
and 71(1) = 7 r(Oi). Its transition probabilities are P(0,1) =' 7 r(l)/(rm) and 
P(1,0) = 7 r( 0 )/(rm). A brief calculation establishes A = l/(rm). [This is di¬ 
rectly from the definition (1) using /(O) = 7 r(l) and /(I) = — 7 r( 0 ), a choice 
that is unique up to scaling among functions with expectation 0.] By induc¬ 
tion, since M\e and M/e are also balanced, A = l/(rm). 

Almost the same argument applies to the log-Sobolev constant a. How¬ 
ever, there is a small technicality that arises from the asymmetry of the 
projection chain. Specifically, we know only the two sides are balanced to 
the extent that 

1 |Hi| 

— < < r. 

m |Ho| 

Unfortunately, while the spectral gap is constant for the asymmetric two- 
state Markov chain, this is no longer the case for the log-Sobolev constant. 
More precisely, using [5], Theorem A.2, we have that 

(rmln( 7 r(Ho)“^-|- 7 r(Hi)“i)) ’ 

which worsens the bound by a factor ln(l/(r -|- m)). 

We can recover from this setback by noting that w{x,y) < min{ 7 r(Ho), 
7 r(Hi)} for all x,y, so that we could have defined P by 

B/ ^ B/ ^ w{x,y) 

P{x,y) = P{y, x) =- ■ s \ —TTTT- 

This definition boosts the transition probabilities between Hq and Hi when 
either 7 r(Ho) or 7 r(Hi) is small, while leaving all transition probabilities 
bounded by l/(rm), as required. This modification to P more than com¬ 
pensates for the effect just identified, and indeed the worst case (calculus) is 
when 7 r(Ho) = vr(Hi) = The bottom line is that we achieve a = l/2(rm). 

These bounds were recently obtained [9] using a longer and more compli¬ 
cated argument tailored to the specific application. 

4.6. Hard-core model on trees. We conclude with an example where off- 
the-shelf decomposition results do not suffice. In this case, a reasonable 
bound on spectral gap may be deduced from Theorem 1. However, the prob¬ 
lem that threatened to arise at the end of the previous example—namely 
that the log-Sobolev constant of a highly asymmetric two-state Markov chain 
may be arbitrarily close to 0—causes real problems here. Nevertheless, by 
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tailoring our decomposition to the problem at hand, we obtain a reasonable 
bound on the log-Sobolev constant. (Just before the final version of this arti¬ 
cle was prepared, Martinelli, Sinclair and Weitz [16] announced substantially 
better bounds than those obtained here. They were able to show optimal, 
i.e., 0(nlogn), mixing over a range of fugacities.) 

Let Td denote the tree, rooted at v, of depth d and branching factor A. 
(Thus, the degree of any vertex that is not the root or a leaf is A -|- 1. The 
degree of the root v itself is A.) Consider the hard-core lattice gas model 
defined on the set of independent sets of T^. For a given fugacity A > 0 
(note that in this section only, A does not refer to spectral gap), we are 
interested in the Boltzmann-Gibbs distribution tt dehned on fl, where 

7r((T) oc A^'^l 

and |(t| denotes the cardinality of the independent set a. 

Once again, a simple Markov chain with state space and stationary 
distribution vr is the following single-site heat-bath dynamics known as the 
Glauber dynamics. For technical reasons we define the chain with respect to 
a parameter N >n, where n denotes the number of vertices in T^. 

From Xt€ it: 


• Choose a vertex z uniformly at random. 

• Set 




\ {^}) with probability 1/(1 -|- A), 

Xt U {z}, with probability A/(1 -|- A). 

If X' G n, set Xf+i = X' with probability n/A; otherwise, set Xt+i = Xt. 


In practice, we set N equal to the number n of vertices in the tree at the top 
level of the inductive argument; the extra parameter eliminates rescalings 
in the upcoming analysis. 

We decompose the state space as H = Hi U 02 U Ha, where 

rii := {fj G n : u e a}, 

^2 := {t G n \ fli: fJ U {u} G fl}, 

fla := n \ rii \ fl2. 

Also let := ll 2 U ria. 

Without loss of generality, assume = 1. Using (25) twice, 

3 3 

W) = E (/)+E f) in(E., f) 

2 = 1 2=1 


< 7r(l)£^,(/) + 7r(4)£^,(/) +f]7r(f)(E^, f)- 

2=1 


(39) 
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Observe that the restriction chain on Oi with transition probabilities Pi 
(where N is constant so that the transition probabilities are identical in 
Pi and P) is simply the product chain of copies of the chain on T(i_2. 
Similarly, the restriction chain on O 4 is the product of A copies of the chain 
on Trf-i. The projection chain also has a simple structure. In particular, 
there is a bijection z/:Oi —> O 2 such that for y = z/(x) we have P{x,y) = 
1/(1 + \)N and P(y, x) = A/(l + X)N. This perfect matching u captures the 
only transitions between the sets fli and 114 . 

Define a new chain on state space {1,2,3} with stationary distribution vf 
(i.e., the same as that of the projection chain on {Di, II 2 , II 3 }) with transition 
probabilities P given by 

P(1,2) = A/(1 + A), 

P(2,l) = l/(1 + A), 

P(2,3) =min{l, 7 f( 3 )/ 7 r( 2 )}, 

P(3,2) =min{l, 7 f( 2 )/ 7 r( 3 )}, 

P(1,3)=P(3,1) = 0. 

(The hctional Markov chain P is a formal device: We establish and apply 
a log-Sobolev inequality for P and then relate the various resulting terms 
to the actual chain P.) Let a denote the log-Sobolev constant of this chain. 
From (39) and the log-Sobolev inequality for P, we now have 

T.(/)< ^ T,, (/,/) + ^ T,, (/, /) 

, , «d-2 Old-l 

(40) 

+ ^ ^ 7r(i)P(i,i + f f. 

We need to bound the last terms on the right-hand side. Beginning with 
i = 1, observe that P(l,2) = AP(1,2). Moreover, the bijection u implies the 
corresponding 77 = 0 , and the following statement holds: 

7f(l)P(l,2)(VE^, ff<NCi2. 

For i = 2 our bound proceeds as follows, starting with an inequality akin 
to (31): 

7f(2)P(2,3)(v'E,, f- v'E ,3 ff 

<7f(2)P(2,3) '^2{x)TT’i{y){f{x) - f{y)f 

X^Q.2 

j/gOs 

< min{ 7 f( 2 ), 7 f( 3 )} Var^ 4 (/) 
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ttd-l 

Substituting these estimates into (40), we obtain 

min{7r(2), 7f (3)} 




Old-2 


Old-1 


1 + 


7 r(4) a 


< max 


I- 


1 


I Od-2 

leading to the recurrence 
(41) 


1 + 


min{7r(2), 7r(3)} 
7f(4) a 


1 N 


Od-l o 




SMJ), 


NCi2 


a 


ad > min<^ ad-2, 1 + 


min{7r(2), 7r(3)} 


-1 


Od-l, 


a 

N 


7r(4) a 

To bound d, we use a result of Diaconis and Saloff-Coste ([5], Theo¬ 
rem A.l) on the log-Sobolev constant of the chain on (the complete 
graph on three vertices) with transition probabilities P{i,j) = vr(j) for all 
1 < j < 3, that is, 

. , 1 f 

“Ng _ - 1) “ 31n(l/7fmin)’ 

where Tt^am = min{7r(l),7r(2),7f(3)}. Comparing our three-state chain (with 
transition probabilities P) with we obtain the following claim. 

Claim 7 . The quantities a and ax^ defined above are related by the 
inequality a > aK^l 2 {\ -|- A). 

Proof. For succinctness, write ](i) := VEtt- /^. Suppose 0 < ^ < 1. Then 
(/(I) - < [(/(I) - /(2)) + (/(2) - /(3))]2 

\T^(/{i) - /{2)) + yrrj ^^{/(2) - /(3)) 

< i(/(i) - hnf +y^(/( 2) - /(3))t 

where the inequality is Cauchy-Schwarz. Now set 

(7f(l) -7 7f(2))7r(3) 


n 2 




7 r(l)7r(2) -|- 27 r(l) 7 r( 3 ) -|- 7r(2)7r(3) 


Then 


7r(l)7r(3)(/(l)-/(3))^ 

)^ 2.(_1M3) ^^(3) 


7f(2) 

^(1)^(2) 

_7r(l) -I- 7f(2) 


7 r(2) -7 7r(3) 


{m-mr 


X 
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Starting with the log-Sobolev inequality for the Diaconis-Saloff-Coste chain 
on ifs and applying the above inequality, we obtain 

OKs^nif) < vr(l)7r(2)(/(l) - f{2)f 

+ vf(l)7f(3)(/(l) - mf + 7r(2)vf(3)(/(2) - mf 


<2 1 + 


+(2) 




7r(l) + 7r(2) 

7r(2)7f(3) 


+ 


<2 1 + 


7i'(l)7r(3) 

+( 2 ) 


7r(2) + 7r(3) 

SMJ), 


im-mr 


where <?#(/,/) is the Dirichlet form associated with the P chain. Hence 

OiKs ^ OiK3 


a > 


2(l + 7f(l)+(3)/+(2)) - 2(1 +A)’ 
as claimed, where the second inequality uses the fact that 7r(l) = A7r(2). □ 


Combined with our earlier estimate (42) for Claim 7 gives 

1 

a; +-. 

6(1 + A) ln(l/7rmin) 

By considering appropriate mappings 0 —> , we see that 

[For example, for the first of these, consider the mapping that forces a 
a U {u} \ r(u), where r(u) denotes the set of neighbors of u.] Thus 

1 ^ (1 + A)^+^ 

TTmin “ min{l,A} ■ 

In the other direction, similar arguments yield 

>f(2)<i »(3)<(1 + A)'"-1, *(4 )>y4^, 

SO that 

, (1 + A)'^ — 1, l|. 

Combining these various inequalities yields 

min{+(2),7f(3)} ^ 6min{+(2),+(3)} (1 + A) ln(l/7rmin) 

+(4)q: “ +(4) 


min{7r(2), 7r(3)} < min 


< 5a(A), 
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where 

(43) 9 i(A) = 6min{i (1 + Ap - 1, l}(l + Af ln(<D^). 

Returning to recurrence (41), 

l/od < max{(l + c/A(A))/ad_i, N/a}, 

leading to 

a~^ < n(l + 

To make sense of this bound on the log-Sobolev constant a, observe that 

5 A(A) = 0(AA(l + |logA|)). 

This estimate can be obtained from (43) by considering separately the ranges 
A < A“^, A“^ < A < 1 and A > 1. In particular, we see that S'a(A) —> 0 as 
A —> 0 for any fixed A. In rough terms, the mixing time tends to be linear 
as the fugacity A tends to 0. 
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